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Abstract. A structure called a decision making problem is considered. The set 
of outcomes (consequences) is partially ordered according to the decision maker’s 
preferences. The problem is how these preferences affect a decision maker to prefer 
one of his strategies (or acts) to another, i.e. it is to describe so called derived 
preference relations. This problem is formalized by using category theory approach 
and reduced to a pure algebraical question. An effective method is suggested to build 
all reasonable derived preferences relations and to compare them with each other. 
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0. Introduction 

It is known that at first a decision making problem (DMP) was built as a struc¬ 
ture with a real-valued payoff function. Later on DMP appeared with a vector¬ 
valued payoff function. We consider a decision making problem with goal structure 
given by a partial ordering relation (preferences of a decision maker) on the set 
of outcomes. At the present moment such decision making problems have become 
of great interest. By the time the article had been written and tested, the inter¬ 
esting paper of Dubois, Fargier, Perny and Prade (2002) appeared devoted to the 
same subject and contained an extensive bibliography. It gives us an opportunity 
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to refer a reader to this paper for the history of the problem. We only mention 
such papers that concern our results immediately. In spite of the common subjects 
the approaches of the present paper and the one cited above are different and re¬ 
sults have no intersections. Below, we describe more exactly relations between the 
present paper and Dubua et al.(2002) that we name for short QDT. 

The main problem considered in the present paper is the ” transference” of pref¬ 
erences from the set of outcomes (consequences) to the set of decision maker’s 
strategies (or acts), i.e. ranking the strategies knowing that some of consequences 
are better than others. Such ranking is called a derived preference relation. The 
point is that such transference of notions and principles used for classical DMPs to 
DMPs with preferences is based usually on intuition and leads frequently to anom¬ 
alies. Further, in the next section, we explain what we mean. The similar problem 
is the subject of QDT, but there are some important differences. 

The set of outcomes (consequences) is assumed in our paper to be partially 
ordered, while in QDT it is completely preordered (weakly ordered). A derived 
preference relation is regarded as a preorder, while in QDT it is assumed to be a 
partial order. But it is not essential because our approach works in all cases. It 
is essential that the authors of QDT formulate that "the real decision problem is 
to build this relation (ranking of acts) from information regarding the likelihood of 
states and the decision maker preference on consequences”, while we take in account 
only last one. They do not explain what ”to build” means but use some axioms 
motivated somehow or other. On the other hand, we concentrate our attention 
on giving a suitable mathematical formalization of the mentioned problem and on 
building all derived preference relations applying obtained mathematical results. 
Thus we think that the present paper is not a rival but an addition to QDT. 

DMP considered in the paper is a structure, which components are a nonempty 

set X of alternatives (strategies) of a decision maker, a nonempty set of states A , 

a partially ordered set (A, u>) of outcomes and a map F that assigns an outcome 

F(x, y) to every strategy x if the state of the world is y. It is to mention that the 
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map F determines a map F* from X to the set A Y . The set A } is called the set of 
acts of the decision maker. Usually, the set of acts is considered instead of the set of 
strategies. But we do not suppose that every act can be realized by the considered 
decision maker. 

A decision maker has to prefer one of his strategy to another according to his 
preferences in the set of outcomes which are given by the partial order u, that 
is he has to ”build” a relation p on the set of his strategies. We think that this 
relation has to be a preorder relation and has to be consistent with the preference 
relation u ; and with the realization function F. We shall call every such relation p a 
derivative preference relation. We look for a general principle to build the derivative 
preference relations for all DMPs like for example the maxmin principle that is 
the main optimality principle in the classical decision making theory. But absence 
of any one-valued (functional) connection between alternatives and outcomes makes 
the problem non-trivial. 

Observe that a decision making problem can be considered as a game such that 
a player knows only his own preferences but does not know the preferences of other 
players. Namely this approach is used in the monograph Moulin (1981). 

A new approach in the present paper is the use of category theory as a ’’method¬ 
ological base” for formalizing the problem. This approach leads to a method of 
constructing of derived preference relations based on algebraic theory of monoids 
of binary relations. The main steps of solving the set up problem are the following 
ones. At first (section 2), the conditions (axioms) are formulated for a derivative 
preference relation. We proceed from minimal assumptions mentioned above and 
the assumption that so called Pareto-domination is a part of every derived prefer¬ 
ence relation. From the point of view of category theory, these conditions mean 
the existence of special functor (preference functor) from the category of DMPs to 
the category of preordered sets. In QDT, the so called Ordinal Invariance Axiom 
is assumed. May be it is at the bottom of some pessimistic conclusion in the men¬ 
tioned paper. Instead of this axiom, we assume much weaker one that is fulfilled 
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for all suggested in literature preference relations. 


Further (section 3), we show that constructing of the preference functor can be 
reduced to the constructing of some special functor from the category of ordered sets 
to the category of preordered sets. The main results are formulated in Theorem 1 
and Theorem 2, that give an effective method to construct the required functors. 
Our method leads to anomalies-free preference relations, and it turns out that 
practically all known ways to specification of derivative preference relations are 
some concrete cases of the given construction (examples in Section 4). Using this 
new method we check some properties of derived preference relations. The last 
section 5 shows how to use the obtained results. Particularly, all derived preference 
relations form a complete lattice. In general case, some maximal and minimal 
preference relations are described. In all finite cases, this lattice can be effectively 
constructed. 

In the first section, we give all necessary definitions and some motivations for 
the present research. 


1 Preliminaries and motivations 

A reader can find the necessary algebraic notions and facts in the book Gratzer 
(1979), so as some notions and facts concerning binary relations and ordered sets. 
But for the convenience of a reader, we recall some fundamental notions of relation 
theory. 

A binary relation p is a set of ordered pairs, usually it is a subset of the Cartesian 

product Ax B of two sets, in this case it is called a binary relation between elements 

of these sets. The relation p _1 = {( 6 , a)|(o, 6 ) G g} is called the inverse relation 

to g. The well known product of binary relations g and a is denoted by a o p, 

that is a o g — {(a, c)| (3 b)((a,b) G p & (b, c) G a)}. A relation p C A x A is 

called reflexive if (Va G A) (a, a) G p, it is called transitive if p o p C p, that is 

(a, 6) G p and ( b , c) G p implies (a, c) G p. A transitive and reflexive relation is 

called a preorder (or quasiorder) relation, it is called a partial ordering relation if 

in addition it is antisymmetric, that is (01,02) G pfll ? _1 01 = 02- Since we 
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consider in the present paper only partial ordering relations, further we often omit 
the word ”partial”. 

For notational convenience we denote preorder and order relations by means of 
usual signs <, > with a symbol of the corresponding relation on top. The greatest 
element a with respect to a preorder relation g on a set A is defined as usual, that 
is for all x G A we have x <" a. Of course, if it exists it is not unique in general, but 
with respect to an order relation it is unique if it exists. An element of an ordered 
set is called minimal or an atom if between it and the least element (if it exists) 
there are no elements. Dually, a maximal or a dual atom is defined. An ordered set 
is called a chain if every two elements of it are comparable (oq < a 2 or a 2 < ai). 
An ordered set is called a lattice ( complete lattice) if every its two elements have 
(every subset has) the least upper bound (supremum) and the greatest lower bound 
(infimum). 

A map / : A —> B from one preorder (A, g) to another (B, a) is called isotonic 
if it takes pairs from 0 to pairs from cr, that is aq < e a 2 =>■ /(a 1 ) < a f(a 2 ). 

If A is a binary relation then its first projection, prg A. is the set of elements a 
such that there exists an element b such that (a, b ) G A, its second projection, pr 2 A, 
is the first projection of the inverse relation A -1 and its reflexive projection, pr&\, 
is the set of all elements a such that (a, a) G A. The equality relation on a set A 
we denote by A^. Thus pr&\ — pr i(A D Aq) = pr 2 (X fl Aq) for A C A x A. 

As for the theory of categories and functors, we can refer a reader to the book 

Mac Lane (1971). But we use only basic notions as the most convenient language for 

our aim, and it is necessary to know only basic definitions. A category C consists of 

two collections, Ob(C), whose elements are the so called objects of C, and Hom(C ), 

the collection of morphisms (or arrows, homomorphisms, maps ) of C. To each 

morphism is assigned a pair of objects, called the domain and codomain of the 

morphism. The notation / : A — > B means that / is a morphism with the domain 

A and the codomain B. If f : A — > B and g : B —> C are two morphisms, there is 

a morphism g o f : A —> C called the composite of g and /. For every object A 
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there is a morphism id A : A —> A, called the identity of A. These data are subject 
to the following axioms: 

(1) For / : A -> B, g : B -> C, h:C -> T> , 

ho(gof) = (hog)of- 

(2) For f-.A^B, 

f o id A = id B ° f = /• 

If C and 2? are categories, a functor F : C —» is a map for which 

(1) If / : A —> B is a morphism of C, then T(/) : _F(A) —> F(B) is a morphism 
of V] 

(2 )F(id A ) = id F ( A y, 

(3) If f:A^B,g:B^C, then F(g o f ) = F(g) o F(f). 

All other definitions will be given when it will be necessary. 

It is known that the maximin principle is the main optimality principle in 
the classical decision making theory. Let A be a set of alternatives (strategies) of 
a decision maker, call I, Y be a set of medium states and f(x, y ) be the payoff 
of I if he chooses the strategy x and the medium is situated in the state y. The 
alternative xq is maximin if sup^, inf y f(x,y ) = inf y f(xo,y), i.e. if it maximizes 
the estimate x —> inf y f(x,y). 

If one considers the triplet Q = (A, Y, /) as a two-player zero sum game, it 
appears along with the maximin principle for the player 1 the dual one for the 
player 2, i.e. the minimax principle: the alternative y o is minimax if it minimizes 
the estimate y —> sup x f(x,y), i.e. infy sup. c f(x,y ) = sup^ f(x,yo). The values 
v\ = sup x infy f(x, y) and V 2 — infy sup x f(x, y) are called the lower value and the 
upper value of the game respectively. By the way, v\ < holds always. If v\ — v -2 
holds it is said that the game Q has a value. 

In two-player zero sum game theory, the saddle point principle is the most im¬ 
portant one. We recall that a point (xo,yo) is called a saddle point if f(x,yo) < 

f(xo,yo) < f(xo,y) for all x € A, y e Y . The existence of a saddle point implies 
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the existence of the game value. Conversely, if a game has the value then every 
pair (xotVo), where a;o is a maximin strategy of the player 1 and Dq is a mini¬ 
max strategy of the player 2, forms a saddle point, and every saddle point can be 
obtained by this way. 

A game with ordered outcomes is a game in which preferences of players are 
given by partial ordering relations on the set of outcomes, that is the goal structure 
of a such game is a set of outcomes that every player orders according to his own 
preferences. In the case of an antagonistic game the goal structure is given by 
means of one partial ordering relation that expresses the preferences of the player 
1, and the preferences of his opponent (the player 2 ) are given by the inverse partial 
ordering relation. 

We consider an antagonistic game as an algebraic structure G = (X. Y. A , uj, F ) , 
where X and Y are the sets of strategies of players 1 and 2 , (A, u;) is a ordered 
set, F is a map F : X x Y —> A that is called a realization function. It is assumed 
only that the sets X, Y and A contain more than one element. The fact a± >^' a 2 
is interpreted in the sense that the outcome a\ is more preferable for the player 1 
than the outcome 02 - If the player 1 chooses a strategy x and the player 2 chooses 
a strategy y it comes out a situation (x,y) that leads to an outcome F(x,y). So, 
the problem arises for every player how to prefer one of his strategy to another. 

The most natural point of view is the following one: a strategy x\ is more prefer¬ 
able for the player 1 than a strategy X 2 if F(x 1 , y) > w F(x 2 , y) takes place for every 
strategy y of the player 2 . It is so called Pareto-domination . The strong Pareto- 
domination means that all inequalities in the definition of Pareto-domination are 
strong. The maximal according to Pareto-domination strategies are called Pareto- 
optimal. But this way has some shortcomings because the problem is reduced to 
the problem of choosing one of the Pareto-optimal strategies. Nevertheless it is 
obvious that if a strategy x\ Pareto-dominates a strategy X 2 it is more preferable 
than last one in any other kind of domination. 

While searching for other more suitable principals of domination, the notions are 
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introduced, that are analogies to the notions of maximin (minimax ) strategy 
and the value of a game in the classic case [see Jentzsch (1964), Podinovski (1979)]. 
The saddle point is defined as usual (see above). Since it can be that an infimum 
of a subset of the ordered set (A, u) does not exist, the following changing is made. 

Denote by V x the set of all outcomes that are ” guaranteed” for the player 1 
by the strategy x, that is: V x — {a G A\(\/y G Y)F(x,y ) >“ a}. The estimate 
x —> inf ;y f(x, y ) is replaced by the estimate x —> V x . If the set V x is assumed as a 
characteristic of the strategy x the relation of so called a-dominating for the player 
1 arises: 

xi < a x 2 V Xl C D X2 . 

The defined relation a is a preorder relation on the set X of strategies of the player 
1. The strategy xq € X is called an a-greatest one if it is the greatest element 
with respect to the preorder relation a. Dually, i.e. by means of rearrangement 
of players and replacing u by a; -1 , the definition of an a-greatest strategy of the 
player 2 is obtained. 

Denote U y — {a G A |(=kc G X)F(x, y ) > w a} and set: 

V = \JV X (the lower characteristic set); 

X 

U — f^| Uy (the upper characteristic set). 

y 

The inclusion VC. U holds always. One can regard it as an analogy to the inequality 
V\ < v 2 . The equality V — U is considered in Jentzsch (1964) as an analogy to the 
existence of a value of the game G. In this case, we call the coincident lower and 
upper characteristic sets the generalized value of the game G. 

A game Q with payoff function can be considered formally as a game with ordered 
outcomes (in this case, the set of outcomes is the set M of real numbers with respect 
to usual order, and the function f becomes a payoff function). Then the cc-greatest 
strategy of the player 1 coincides with his maximin strategy, and the cc-greatest 
strategy of the player 2 coincides with his minimax strategy, and the equality 
V = U implies the equality V\ = v 2 . Thus the introduced analogies seem to be 



quite natural. But they have some anomalies (some of them were mentioned in 
Jentzsch (1964), Podinovski (1981), Rozen (2001)). 

Example 1 

Consider the game G = (X, Y. A , u F) with ordered outcomes, where the ordered 
set {A, to ) is the following 5-elements lattice: {0 < a, b, c < 1}, and with realization 
function F given by the table: 


F 

yi 

V2 

V3 

X\ 

b 

c 

0 

x 2 

0 

a 

1 


Here X\ is the a-greatest strategy of the player 1 . y\ is the ce-greatest strategy of 
the player 2 and V — U. However, the pair [x \, ij \) does not form a saddle point, 
and this game has no saddle points at all. Besides this, the dual condition V* — U* 
is not satisfied, i. e. the condition of the existence of a generalized value is not 
invariant with respect to duality, when the players change places. 

Example 2 

Consider the antagonistic game G = (X, Y, M 2 , u, F) with vectorial payoffs (i.e 
with respect to component-wise ordering), where X = {xi,x 2 }, Y — {yi, 2 / 2 } and 
the function F is given by the following table: 


F 

yi 

y2 

Xi 

(2.1) 

(1,3) 

X 2 

(4,0) 

(0,5) 


We see that 

V Xl = {( p,q ) e M 2 | (p, q) < (2, 1) & (p,q) < (1,3)} = {(p,q) G M 2 | (p, q) < (1, 1)}; 

K 2 = {(p,g) e M 2 j (p, q) < (4,0) & (p,g) < (0,5)} = {{p,q) G M 2 j (p, q) < (0,0)}. 

Hence V X2 C V Xl . that is x i > a a:2 and therefore X\ is the ct-greatest strategy. 
However, if we ” convolve” the vectorial payoffs according the formula (p, q) —> p + q 
we receive the following game: 

m 
_3 
4 
9 


F_ 

X\ 

x 2 


V2 

4 
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In this game, X 2 is the a-greatest strategy but not x\. The new game is an 
homomorphic image of the previous one. Thus for the games with ordered outcomes, 
an a-optimal strategy can be changed by passing on to homomorphic images. 

Example 3 

With the preceding example notation, let the antagonistic game G have the 
following function F: 


F 

yi 

1 J 2 

Xi 

( 2 . 1 ) 

( 1 . 2 ) 

X2 

( 3 . 1 ) 

( 1 . 3 ) 


Here the strategy X 2 Pareto-dominates the strategy x\ but it holds V Xl — V x . 2 . 
Thus it may be that two strategies are equivalent with respect to the ct-domi nation 
and one of them strongly Pareto-dominates the other. 

Example 4 

Consider the game G = ( X , Y. A , u F) with ordered outcomes, where the ordered 
set {A, u) is the following 5-elements lattice: {0 < a, b,c < 1}, and with realization 
function F given by the table: 


F 

yi 

V2 

X\ 

b 

1 

x 2 

c 

a 

x 3 

1 

0 


Here the strategy x\ is the a-greatest strategy. Extend the set A up to A 
by adding new elements /, g and h and extend the order on A by setting 0 < 
/, g,h ; g < a, c; h < b , c. In the obtained game G, we have V X2 — {0, g}, V Xl — 
{0, b}, V X3 — {0}, hence the strategies x\ and X 2 are incomparable with respect to 
the a-domination. Thus the condition to be an a-greatest strategy is not preserved 
by adding some noil-realized outcomes. 

On the base of shortcomings mentioned above, we can make a conclusion that 
the set of all outcomes that are ” guaranteed” for the player 1 by a strategy is 
not a good characteristic of it. There is more fine characteristic based on another 
approach. Let (A, 00 ) be an ordered set. It is possible to extend the relation uj up 
to set of all subsets of A by the following two ways: 

A\ A 2 <=>• (Vaj G Ai )( 3a,2 G ^2)01 ( 12 ] 
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A\ <A A 2 <=> (Vci2 G A 2 )(3ai G Ai)ai ci2- 

Applying these relations to the set of the kind A x — {F(x,y) \ y G Y} we obtain 
notions of so called (5 — domination and dual f3 — domination. The explicit forms 
of them are the following ones: 

xi <P x 2 (Vyi G Y)(3y 2 G Y)F(x 1 ,y 2 ) <“ F(x 2 ,yi); 

xi <? x 2 (Vyi G T)(3y 2 G y)F(a;i,yi) < w F(x 2 ,y 2 ); 

These relations agree with the approach of Berge (1957) to sort out the players 
into active and passive ones. A 11 active player wants to have at least one good 
outcomes and a passive one does not want to have a bad outcome. 

j3 — domination is interrogated in Rozen (2001), it coincides with relation R g2 
introduced by Podinivski (1979). 

2 Preference functor 

The main model under consideration is DMP of the following kind 

G=(X,Y,A,u,F), (1) 

where X,Y,A are arbitrary (nonempty) sets, u C A x A is a (partial) order relation, 
F : X x Y —> A is a map. This model is interpreted in the following way. The set X 
is a set of alternatives (strategies) of a decision maker, the set Y is a set of states and 
A is a set of outcomes (results). The order relation uj expresses the preferences of 
the decision maker. And the map F is a realization function (although its values are 
not assumed to be real numbers). We assume the following underlying conditions 
(axioms) for any derived preference relation p C X 2 : 

(Al) the relation p is a preorder relation on X ; 

(A2) the relation p contains the Pareto-domination relation; 

(A3) a ” strengthening” of the relation u implies a ” strengthening” of the relation 
p, in other words, by adding new outcomes or new comparable pairs to uj. the 

existing preferences of alternatives have to be saved. 
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We note that the axioms (Al)-( A3) are from the valuable point of view the minimal 
system of natural requirements. The mathematical sense of axioms A1 and A2 is 
clear, and an exact form of the axiom A3 will be given below on the base of category 
theory. 

Fix sets X and Y and consider the category Q(X,Y) which has as objects the 
DMPs G = (X,Y,A,uj,F), and a morphism from G = (X,Y,A,u,F) to G 1 — 
(X, Y, B , 5 , H ) is a map / : A —> B satisfying the following two conditions: 

ai < w a 2 => /(ai) < 5 /(a 2 ); (2) 

f o F = H. (3) 

The condition (2) means that / is an isotonic map of the ordered set (A,uj) to the 
ordered set ( B , 5) and the condition (3) means that / transfers the function F to 
the function H. In other words, we consider a DMP (1) as a structure with base 
set A, one binary relation u> and a family of 0-ary operations {F(x,y)}r x ,y)eXxY, 
and the defined morphisms are usual homomorphisms of structures (see Gratzer 
(1979)). 

Further, a ” strengthening” of preferences on the set of outcomes of the given 
DMP G = (X,Y, A,u, F) can be formalized as an isotonic map / : A —> B of 
the ordered set {A,cu) to an ordered set {BA), and as a result a new DMP G 1 — 
(X, Y, B ,S, H) appears, where H = / o F. Thus a ” strengthening” is a morphism 
of the category G(X, Y). 

Denote by Q{X) the category which objects are preorder relations on X, and for 
p C X x X and a C X x X the set Hom{p , cr) contains only one morphism if p C a 
and is empty otherwise. Since our aim is to associate with every DMP a preorder 
relation p C X x X (a derived preference relation) in such a way that the condition 
(A3) is satisfied, we have to consider a map T which assigns to every G{X, y)-object 
G a preorder relation T(G') on X in such way that for every morphism G G l the 
inclusion T(G) C T(G 1 ) is satisfied. Thus we have to construct functors from the 
category G(X, Y) to the category Q(X). This is the mentioned category-theoretical 
formalization of the axiom A3. 
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Consider the set A^ of all maps from Y to A. For every order relation c o on the 
set A. we have the order relation Co on /C : (a,/3) Gu-S* (Vy G Y) a(y) < u /3(y). 
As it is known, we can associate with every map F : X x Y —> A the map F* : 
X —> Ad , that assigns to every element x G X the map F* : y —» A by the rule: 
F* (y) = F(x, y) for all y G Y. 

Let P be a map that assigns to every DMP G = (X, y, A,u, F) the relation 
F* _1 (a>) = F*- 1 oCooF*. We have 

P(G) = {( Xl ,x 2 )\ (Vy G y)F(x!,y) F(x 2 ,y)}. (4) 

It is exactly the Pareto-domination for G. Let f : A —? B be a morphism from G — 
( X , y, A, F) to G 1 = ( X , y, B , 5, F). Then according to definition of morphisms, 
we have: 


(®i,® 2 ) e P(G) => (Vy e y)(/ ° F)(xi,y) < s (foF)(x 2 ,y) => 

=> (Vy e y) H(xi, y) < 5 H(x 2 , y) =» (xi, x 2 ) G ^(G 1 ), 

that is P is a functor from the category Q(X,Y) to the category Q(X). We call it 
the Pareto functor. 

Definition 1. A functor T : Q(X,Y) — > Q(X) is called a preference functor if 
P(G) C T(G) for every DMP G = (X, Y, A, u, F ) . 

From the point of view of this definition, the conditions (Al)-(A3) mean that 
we deal with preference functors from the category Q(X,Y) to the category Q(X). 

Our definition of a preference functor is very general. All preference relations that 
are considered in the literature indeed satisfy more one condition which seems to be 
natural, but we have never seen it in an explicit form. Roughly speaking this condi¬ 
tion means that we choose the same preferences being in similar situations. Consider 
two situations (xi,yi) and (x 2 ,y 2 ) that lead to outcomes F(xi,yi) and F(x 2 ,y 2 ) 
respectively. We can compare these situations by means of order in A, namely the 

second situation is preferable than the first one if F(xi,yi) < w F(x 2 ,y 2 ). This 

13 



approach leads to a relation in the set of states for every pair of strategies (aq, x 2 ). 
It seems to be naturally to take into account this relation. Below we give the exact 
definition. 


Definition 2. The state-preference for the pair (xi,X 2 ) with respect to DMP G is 
the following relation on the set of states Y : 

Pg{x i,x 2 ) = {(2/1, 2 / 2)1 F(x 1 ,y 1 ) < u F(x 2 ,y 2 )}. ( 5 ) 

Definition. A preference functor 'I' : Q(X, Y ) —> Q(X) is called regular if it satis¬ 
fies the following condition: 

(M) 

if Pg(xi,x 2 ) = PG'{x 3 ,x 4 ) then 

(xi,x 2 ) e W(G') (x 3 ,x 4 ) g W(G') (6) 

Now we show that so called Ordinal Invariance Axiom (OIA) (see QDT ) is 
more stronger that A4. OIA means in our notations that for xi,x 2 ,x 3 ,x 4 G X, if 
{y G Y | F{x 1,2/) F(x 2 ,y)} = {y e Y\ F(x 3 : y) < s F(x 4 ,y)} then (xi,x 2 ) e 

y(G)^(x 3 ,x 4 )ey(G'). 

Let pg(x i,x 2 ) = pg'(x 3 ,x 4 ). The fact F(xi,y) <F F(x 2 ,y) means that (y,y) € 
Pa(xi,x 2 ). The last one is equal to (y, y) € Pg{x 3 , x 4 ), that is equal for one’s turn to 
F{x 1 ,y) < 5 F(x 2 ,y). Hence {y e Y\ F(x 1 ,y) <“ F(x 2 ,y)} = {y G Y\ F(x 3 ,y) < s 
F(x 4 l y)} and OIA implies that (x 4 ,x 2 ) G 4/(0) (cc 3 ,a: 4 ) G T(G"). Thus OIA 

implies A4. 


3. Main results 

In this section, we give a method of constructing of all regular preference functors 

T : Q (X. Y) —> Q(X) and consider connections between them. It is obvious that 

the required construction is not to depend on sets of strategies X and realization 

functions F because the last ones only choose and rename some maps from Y to A. 

We should mention that some authors consider from the very beginning preorder 
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relations on A Y , the sets of acts of a decision maker (see for example Barthelemy 
et al. (1982), Dubois et al. (2002)). But we do not assume in contrast to this point 
of view that all mappings are possible acts. However by constructing of preference 
functors, we consider preorder relations on the set AC 1 without connections with 
functions F. The following fact gives a reason for such approach. 

Recall that every map f : A —> B determines a map / : A —> S' 1 under formula: 
f(<p) = / o ip for all (p : Y —> A. Denote by Q the category of all preordered sets 
and isotonic maps between them. 

Proposition 1. 

(1) Let T : Q(X,Y) —> Q(X ) be a preference functor. Consider a map 3 that 
assigns 1) to every DMP G = (X, Y, A,lo, F) the preorder relation on the set A y 
generated by F* o ^(G) o F*~ l and Cj and 2) to every morphism of DMPs f the 
map f. Then 3 is a functor from the category Q(X,Y) to the category Q. 

2) Assume that we have a functor 3 from the category of all ordered sets to the 
category Q which assigns to every ordered set ( A,u) a preorder relation 3(u;) on 
the set A Y and such that the following two conditions are satisfied: 

(i) u<Z E(u) ; 

(ii) if f : A —> B is an isotonic map of the ordered set (A, u>) into the ordered 

set ( B,5 ) then £(/) = / : A^ —> . 

Then the map T which assigns to every DMP G = {X,Y, A,ou, F) the preorder 
relation F* _1 (S(c<;)) determines a preference functor from category Q(X,Y) to the 
category Q(X). 

Proof. (1) Given a DMP G = (X, Y, A, u>,F) , consider the kernel of the map F*: 
£f* = {{x\,X 2 )\ F* = Ff 2 }. We see that £f* is included in the Pareto-domination 
relation. Since P(G) C T(G) and £p* C P(G), the inclusion £p * C \k(G) holds. 
Therefore the preorder relation generated by F* o T(G'j o F*~ 1 and Co is equal to 
uoF*o$ ( G ) o P 1 * -1 o Co U Co. Now we prove that the map f : a? —> is isotonic. 
In fact, we have / o F* o T(G) o P 1 * -1 o / _1 = (/ o F )* o T(G) o (/ o p 1 *) -1 = 
PL* o$(G)o H*~ l . 
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It is well known (and quite obvious) that if / : A —» A is the identity map then 
S(/) = / is also the identity map on A 1 and that for f : A —> B, g : B —> (7 the 
equality g ° f — g ° f- Thus S is a functor. 

(2) Let S be a functor satisfying the hypotheses. Let G — (X,Y, A,u, F) and 
G 1 = (X,Y, B , S, H) and f : G G 1 be a morphism. Since / is an isotonic map, 
the map / also is isotonic and therefore (F *^, F* 2 ) E H(u;) =>• (/(F^), f{F* 2 )) E 
S(< 5 ). Under formula (3), f{F*) — H* holds for arbitrary x E X. Therefore the 
following implication is true: (F *^, F* 2 ) E S(t j) =>• G S(h). Hence 

F* _1 (S((n)) C LZ"* -1 (S(h)). In other words, we can define that T(/) is an inclusion 
T(G) C f (G 1 ) . It is enough for conclusion that T is a functor. The condition (i) 
implies that P(G) C T (G). i.e. the functor T is a preference functor. □ 

According to Proposition above, we begin to construct functors H from the cate¬ 
gory of ordered sets to the category of preordered sets satisfying the conditions for 
a regular preference functor, that is 

1) it assigns to every ordered set (A,u) a preorder relation S(w) on the set A y 
and to every isotonic map / : A —> B the map / : A y —> B^ ; 

2) it includes the Pareto functor: cD C H(a;) for all ordered sets (A, u) ; 

3) it is regular: if (A, u) and ( B , 5) are ordered sets and V’ -1 ouoip = 1 ouo^j 

holds for (p, ip : Y A and :Y —> B then E S(a;) E S(<5). 

We call such a functor also as a regular preference functor. 

We recall that a monoid is a nonempty set M together with an associative 
binary operation (multiplication) and an element 1 called an identity , such that 
ml = lm = m for every m E M. The set Tt(y) of all binary relations on Y is a 
monoid with respect to composition of binary relations and the identity A y (see 
Introduction). We call a subset 21 of 93(1") a closed submonoid if it satisfies the 
following conditions: 

1) a, /3 g21=^/3oq:G21; 

2) A.y E 21; 

3) aG2l & a C /? => /3 g 21. 
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Consider an ordered set (A, ca) and choose some closed submonoid 21 of 21(1"). 
Define a relation 2l(ca) on the set A 5 setting for arbitrary (pi : <p 2 G A y : 

(<Pi,<P 2 ) e 21 (u) {(yi,y 2 ) g F 2 | <pi(yi) <“ <^ 2 ( 2 / 2 )} g 21. (7) 

It can be expressed also by the formula : 

(ipi, (p 2 ) G 2l(ca) pf 1 0 u o Ti G 21- ( 8 ) 

It is easy to see that 2l(ca) is a preorder relation on A 1 . Indeed, for every 
: F —> A it holds Ay C <p _1 o u o ip , thus we have o a; o p G 21, hence 
(p,p) G 2l(ta). Further, if (p,if) G 2l(a;) and ('*/’, 7 ) G 2l(cn), then (<p, 7 ) G 2l(u>), 
because y -1 ouo))o 'i /; -1 oyo^C y _1 o ca o <p. 

Theorem 1. Let 21 he a closed submonoid of 21(F). The map T that assigns 
to every DMP G = (X,Y, A,u, F) the preorder relation T’* _ 1 (2l(a;)) determines a 
regular preference functor from the category Q(X,Y) to the category Q{X). 

Proof. 

Let (A, u) and ( B , S) be ordered sets. Let / : A —> B be an isotonic map. 
Let further (<p, if) G 2l(ta). The last one means that ip -1 0 00 o <p G 21 . Since 
■0 -1 o ca o p C g/ 2^ 1 o / _1 o/oyo / _1 o / o (p C (/ o t/;) -1 o h o (/ o <p), we have 
{fopjo^e 21(h). 

The fact above can be expressed in the following words: every closed submonoid 
21 of 21(F) determines a functor S from the category of ordered sets to the category 
Q of preordered sets. This functor assigns to every ordered set (A, u) the preordered 
set ( A 1 , 2l(ta)) and to every isotonic map / of (A, uj) in (L?,h) the isotonic map / 
of (A y , 2l(ca)) into ( B 1 ,21(h)) . 

Now we apply the part (2) of Proposition. The condition (ii) is fulfilled. Verify 
the condition (i), that is for all pi, p 2 G A 1 : (\/y G Y)pi(y) <X ip 2 (y) (<pi, P 2 ) G 

2 l(ca) holds. 

Indeed, if (\/y G Y)pi(y) <“ ip 2 (y) then Ay C pf 1 oyo^j and therefore 
< pf 1 o uj o p 1 G 21. 
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Then the conclusion of Proposition means that the map T which assigns to 
every DMP G = (X,Y,A,u,F) the preorder relation F* _1 (2l(c<;)) and to ev¬ 
ery morphism / : G = (X, Y, A, u, F) —> G 1 = (X,Y, B,S, H) the inclusion 
F* _1 (2l(u;)) C FP _1 (21(5)) is a preference functor from the category Q(X,Y) to 
the category Q{X). 

Further, we have for two DMPs G — (X , Y, A, u>, F) and G 1 = (X , Y, B 1 5, H ) : 
(x 1 ,x 2 )e^(G)^(F: i ,F: 2 )e^ IM, 

(x 3 ,x 4 ) € ^(G 1 ) « H;j 6 2l(<5). 

If po(x 1 ,^ 2 ) = Pg 1 ( x 3 j x ^)j then according to (5) right sides of these formulas are 
equivalent and hence {x\ 3 xf) £ 'L(G) (x^, xf) G ^/(G 1 ), that is (6) is fulfilled. 

Thus the functor T is regular. □ 

Theorem 1 shows that choosing some closed submonoid 21 of the monoid of all 
binary relations on the set Y we can construct derivative preference relations for 
every DMP from Q(X , Y). The next theorem shows that this is a way to obtain all 
regular preference functors. 

Theorem 2. 

LetE be a regular preference functor from the category ordered sets to the category 
Q. Denote by 21 the set of all binary relations on the set Y of the form if~ l ou op 
where (p,if) £ S(u;). Then 21 is a closed monoid of relations and 2t(a>) = S(u;) for 
every ordered set (A, u). 

Proof. Consider the trivially ordered set (Y,Ay). Since for every ip : Y —■► Y, 
(tp, c p) G H(Ay) holds, we have p~ x o Xy o <p G 21. For the case p is the identity 
map, we obtain that A y G 21. 

Let p, a G 21. Then there are ordered sets ( A. ou) and ( B,S ) and there are maps 
Pi,i>i : Y —> A, (p2,f>2 ■ Y — > B such that (pi,ifi) G S(u;), (^2,^2) G S(< 5 ) and 
p — iff 1 o u) o p 1: a = iff 1 o u> o p 2 . If can be assumed that sets A and B have 

not common elements. Consider the relation t — ivUSU6op 2 o iff 1 0 w on the set 
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A U B. It is easy to see that r is an order relation on this set. For each y G Y we 
have 

(i’i(y),<P 2 {y)) e 5 o (^ 2 o Vq 1 o u c r. 

Consider two inclusions f : A ^ AU B and g : B —» A U B. Under definition 
r, they are isotonic. We conclude from the formula above, that (f o ipi,g o p 2 ) G 
S(r). But since the maps are isotonic, we have also (/ o pi, f ° 'i/q) G S(r) and 
(<7 o ip 2 , g o ^ 2 ) € S(r). Therefore (/ o p 1 , g o ip 2 ) G S(r). Further we have: 

Ip^ 1 0 g- 1 0 T O f 0 ip 1 = 1p~ l O 5 O p 2 o ^r 1 = 

and hence <7 o p 6 21. Thus we have proved that 21 is a monoid. 

Now we have to proof that this monoid is a closed submonoid of D\(Y). Firstly 
observe a trivial fact that every relation a C Y x Y can be represented in the form: 
cr = ip~ 1 o u> o for some ordered set (A, u ;) and maps p,ip :Y —> A. Indeed, let Y\ 
and Y 2 be two copies of Y without common elements. Let p : Y —> Y\ and ip : Y —> 
Y 2 be the corresponding identification maps. Define u = Ay x U Ay 2 U ip ° a ° p _1 . 
It is true that u> is an order relation on A = Y\ U Y 2 because a pair of different 
elements belongs to c c only if the first of them belongs to Y\ and the second one 
belongs to Y 2 . It is easy to see that a = ip~ l o u> o p. 

Let p C a and p G 21. The last one means that there exist pi,ipi :Y —> B 
and order relation 5 in B such that p = ippp 1 o 5 o p 1 and (pi,ipi) G S(5). As it 
was mentioned above, a — ip -1 o uj o p for some maps p,ip : Y —» B and order 
relation u in B. Consider the ordered set (ixB,uX(5) where ((ai, 61 ), (< 22 , 62 )) G 
u x S GG (ai,a 2 ) G uj & ( 61 , 62 ) £ S. We have two natural maps a,(3 : Y —> 

Ax B where a(y) — (p(y),pi(y)) and (3{y) = (ip(y),ipi(y)). It is easy to see that 
/3 -1 o (a; x 6 ) o a = p. Since the functor S is regular, the last equality means that 
(a, (3) G S(c v x 6 ). Using the isotonic map n : A x I? —» A, projection on A, we 
obtain that (p,ip) G S(u;), and hence cr G 21. Therefore the monoid 21 is closed. 

Now let ( p,ip ) G 2l((n) for some ordered set (A,u>). It is equivalent according to 

(8) that p — ip -1 o u> o p e 21. The last fact means that there exist pi, ipi : Y 
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and order relation S in B such that p = ip 1 1 ° <S ° <pi and (<£>i, Vh) G S(<5). Since the 
functor H is regular, it is equivalent to G H(u;). Therefore 21 (cu) = E(cu). □ 

3. Examples and applications. 

Thus to observe all closed preference functors from the category Q (X. Y). we have 
to observe all closed monoids of relations on the set Y. In reality, it is sufficient 
to choose a submonoid of 21 (Y) and then consider all relations which include its 
members. All closed submonoids of 21 form a lattice with respect to inclusion. This 
lattice is complete. The least element of this lattice is submonoid of all reflexive 
relations and the greatest one is 21(1") itself. We show below that the submonoid of 
all reflexive relations gives the Pareto-domination. Clearly, 21(1") gives the greatest 
preference relation, i. e. the complete relation on A: X x X. If 21 is a closed 
submonoid of 21(1"), then the set of all relations p _1 for g G 21 also is a submonoid 
of 21(1"). Thus to every preference functor, there is the dual one. If they coincide, 
we have a self-dual preference functor. Below we give some useful examples. 

Examples 

1. Consider the set of all reflexive relations on the set 1". Clearly, it is a sub¬ 
monoid of 21. Let 21 be this submonoid. The corresponding derivative preference 
relation is the Pareto-domination. Indeed, 

(a, (3) G 2l(u;) Ay C (3~ l oyoa-s- (Vy G Y)a(y) < w (3{y) (a, /3) G u. (9) 

2. We call a relation on Y surjective if its second projection is equal to Y. Clearly, 
all such relations form a submonoid of 21. Let 21 be the submonoid of all surjective 
relations. The corresponding derivative preference relation is the /3-domination 
defined in Section 1. Indeed, 

(ct, (3) G 2l(a>) pr2((3~ 1 o uj o a) — Y (Vy G Y)(3y' G 1") a(y') <“ (3{y). (10) 

Thus 

( Xl ,x 2 ) G F*~\ 2f(u;)) {'iy){3y')F{x l} y') <“ F(x 2 ,y). 
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3. Dually to the previous example, let 21 be the submonoid of all everywhere 
defined relations (it means the first projection of a relation is equal to Y). The 
corresponding derivative preference relation is the dual /3-domination. The proof is 
the same that above. 

4. Recall that a filter on the set Y is a set 5 of non-empty subsets of Y satisfying 
the following conditions: 1) Y e 2 ) A, B E $ implies A fl B E 5 and 3) A E 5 
and A C B implies B E 

Let 5 be a filter on the set Y. Define 2f = {A C Y x Y\ pr& € 5}- The 
corresponding derivative preference relation is the preference according to the Liter. 
It can be expressed as follows: a strategy x 2 is more preferable than a strategy x\ 
if the set of all y for which F(x±,y ) < w F(x 2 ,y ) belongs to the filter J. The well 
known interpretation: ’’the majority vote for”. 

A Liter 5 is called principal if it is of the following form: 5 = {P C Y\ Pq C P, 
where Po is a Lxed subset of Y. One can consider the set Po as a system of 
dominators. If particularly Pq consists of one state only, this state can be considered 
as a indicator (or a dictator): a strategy x± is preferable than x 2 if and only if the 
strategy x\ gives for this state the result better than X2 ■ If the set Y is Lnite, every 
Liter is principal. 

5. Let a be an idempotent relation on the set Y, that is a o a — a. It means 
that a decision maker has some special preferences on the set of states. Denote by 
21 the closed monoid generated by a. It consists of reLexive binary relations and 
all binary relations containing a. We have 

(a,/3) e 2l(w) (a, f3) E u V (Vyi,y 2 e Y)((yi,y 2 ) E a => a(y t ) <“ /3(y 2 )). (12) 

According to this we obtain a new derived preference relation. 

We recall that Example 3 given in Section 1 presents two strategies equivalent 
with respect to cu-domination such that one of them strongly Pareto-dominates the 
other. Although ^-domination can not be realized by means of a preference functor, 
such undesirable event can appear, for example if one chooses the greatest monoid 


21 . 
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Definition 3. Let G be a DMP. Let P(G) str denote the strong Pareto-domination 
for G. A preference functor W : G{X, Y ) —> Q(X ) is called suitable for the G if the 
following condition is satisfied: 

(AS) 

1(G) n P(G)p = 0, 

The condition above means that it is impossible that two strategies X\ and 
X 2 are equivalent with respect to preference relation T(G') but ;x 2 strong Pareto- 
dominates x.\ . It is obvious that Pareto preference functor is suitable for all DMPs. 
In general case a preference functor can be suitable for some DMPs and non-suitable 
for another ones. 

Proposition 2. Let 21 be a closed submonoid o/9I(U). If every relation p E 21 has 
a fixed point y, i. e. (y , y ) E p, then the preference functor T determined by 21 is 
suitable for every DMP. 

Proof. Let G = (X,Y, A,u>, F) be a DMP. Suppose that (oi,(3) E 2l(u;). It means 
that ft -1 o tv o a E 21. Under hypotheses, this relation has a fixed point yo. For 
this point a(yo) (3(yo) holds. Hence it is impossible that (\/y)/3(y) <“ ct(y). It 
means that T(G) fl P{G)f^ r = 0. □ 

Corollary 1. The preference functor according to a filter on the set Y (example 
4) is suitable for every DMP . 

Proposition 3. Let 21 be a non-universal closed submonoid ofyt(Y). If 2l(u;) fl 
ujftl -f- 0 ; then ( A,u> ) contains a chain a\ < a 2 < ... < for every positive integer 

k. 

Proof. Suppose that there are (p,if E AA such that (<p, if) E 21 (ex) but if(y) < u p(y ) 

for all y E Y. Then the relation p = {( 2 / 1 , 2 / 2 ) | p(y 1 ) ^( 1 / 2 )} = V ;_1 0 a: o p 

belongs to 21. Hence p k E 21 for arbitrary natural number k. Since <p o if- 1 C u) S ( r . 

p 2 = if -1 o (j o ip o if- 1 o (jj o (p C if- 1 o u> str o ip, and further p 3 C if _1 o uj 2 tr o p, and 

so long, ..., p k C if- 1 o iOgh- 1 o ip. Since sub monoid 21 is closed if- 1 o uj k tr o p e 21 

for all k. Under hypotheses, 21 is not universal and therefore all these relations 
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are not empty. It gives a sequence a i..... a*, for every integer k > 0 such that 

ai < a 2 < ... < afc . □ 

Corollary 2. If lengths of all strong chains in the set of outcomes of a DMP G 
are bounded above, then every non trivial derivative preference relation is suitable 
for G, particularly for all DMPs with finite set of outcomes. 

Proposition 3 generalizes the following result obtained in [Rozen (2001), Theorem 

2 ]- 

Corollary 3. If the ordered set of outcomes for a DMP G satisfies descending 
(increasing) chain condition then (3-domination (inverse (3-domination) preference 
functor is suitable for G. 

Proof. The submonoid 21 corresponding to /^-domination preference functor consists 
of all surjective relations. Suppose that 2l(u;) ft u~ t ]. ^ 0. Then with the notation 
of the proof of Proposition 3, the relation if~ l o wj tr o tp is surjective. It means 
that for every y G Y there is y\ e Y such that (<p(yi), <p(y)) G u> * tr ■ It leads 
to an infinite descending chain in A. This contradiction shows that /5-domination 
preference functor is suitable for G. 

5. Conclusion 

The approach suggested in the paper and based on category theory leads to a 
strong definition of derived preferences of a decision maker and the obtained results 
give a method to observe all such preferences and compare them with each other. 
The most important point is that we start from minimal conditions and therefore 
include all reasonable other approaches but exclude all anomalies mentioned in 
Section 2. The second point is that we reduce the problem formulated in Introduc¬ 
tion to pure algebraical one, namely to study closed monoids of binary relations. 
Indeed, using Theorems 1 and 2 it is possible to build (of course, if the set Y of 
states is finite) all regular preference functors for given set X of strategies. One 

must mention that these theorems establish connections between regular functors 
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(from the category of all ordered sets to the category of preordered sets) and closed 
monoids and are new. 

It was said that all closed monoids of relations on the set Y form a lattice. This 
lattice is a complete lattice. If a monoid 2tj is a submonoid of a monoid 20 and £1 
and £2 are the corresponding derived preferences relations on the set X for a DMP 
G. then we have £1 C £ 2 . It can be interpreted that preference £2 is stronger than 
£ 1 : if X 2 is preferable than X\ in the sense of £1 it is preferable than X\ in the sense 
of £ 2 . 

In the simple cases, when the set Y is not too large, one can describe explicitly all 
derivative preference relations. For example, when the set Y has only two elements 
there are only 16 binary relations on Y, the derivative preference relations are: two 
extremal relations (the universal one and the Pareto-domination), two relations 
associated with two principal filters, the /3-domination, the inverse /3-domination 
(four maximal relations only) and their intersections. In the case when Y contains 
more elements it is more complicated computational problem, but is seems that the 
most important thing is to give a qualitative description which does not depend on 
a set of states. 

The Pareto-domination is the weakest derivative preference relation. The uni¬ 
versal (all strategies are equivalent) relation is the strongest derivative preference 
relation. It is very easy to proof that the monoid of all surjective relations and the 
monoid of all everywhere defined relations are maximal closed submonoids (dual 
atoms). It means that /3-domination and inverse /3-domination are maximal prefer¬ 
ences, i.e. there are no preference relations between each of them and the universal 
relation. 

It may be that a decision maker has some preferences also in the set Y. One 

can take such preferences in consideration choosing a filter on the set Y or some 

idempotent relation on it. This leads to the derived preference relations described 

in the examples 4 and 5 in the Section 4. The preference relations associated with 

principal filters (the case of dictators) are also maximal ones. 
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Taking intersections of these known monoids we obtain new preference relations 
that are weaker than their parents. For example, considering the intersection of 
(3- and inverse /5-domination (i. e. the monoid of all everywhere defined surjective 
relations) gives a new preference relation that can be expressed by the formula: x 2 
is preferable than X\ iff 

( Vyi)(3y2)F(x 1 ,y 1 ) < F(x 2 , 1 / 2 ) a (\/y 2 )(3y 1 )F(x 1 ,y 1 ) < F(x 2 ,y 2 ). (13) 

On the other hand one can consider minimal preference relations (atoms). Let 
2/0 G T be a fixed element. Build the relation g — Y x Y\{(y 0: y 0 )}- It is a maximal 
relation and go g = Y xY. Thus all reflexive relations and g form a closed monoid 
that clearly is a minimal element in the lattice of all closed monoids. This is a way 
to build all minimal derived preference relations. The sense of them is obvious: x 2 
is preferable than x\ iff x 2 Pareto-dominates X\ or F(x\,yi) < F(x 2 ,y 2 ) for all 
pairs of states ( yi,y 2 ) different from (yo,yo) . It means that if a decision maker 
wants to ignore for some reason the correlation between F(xi,yo) an d F(x 2 ,yo) 
he has to check the inequality above for all pairs of states, with the exception of 
(2/o, 2/o)- 

We see that there are many different preference functors. But it is not a short¬ 
coming, it is the nature of things. Practically, we choose one of these functors 
following supplementary data. For example, one can consider some structures on 
the set of states like mentioned above or a probability distribution and use corre¬ 
sponding preference functors. 
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